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ABSTRACT 

The General Accounting Office (GAO) examined private-sector 
worlcforce training practices for information technology (IT) and non-IT 
professionals. Data were collected from the following sources: a literature 
review; discussions with academic and professional authorities; interviews 
with executives and managers at leading companies regarding their IT training 
management practices and activities; and a panel discussion. The study 
identified 22 existing and emerging practices, in the following areas that 
leading companies are using to implement effective IT training. The 
management processes and selected practices identified were as follows: (1) 

align IT with business goals (enlist executive-level champions, involve 
critical stalceholders ) ; (2) identify and assess IT training needs (document 

competencies/slcills required for each job description; perform gap- analyses 
to determine needed training) ; (3) allocate IT training resources (use an 

investment process to select and manage training projects; provide resources 
for management training); (4) design and deliver IT training (give trainees 
choices among different training delivery methods, build courses using 
reusable components); and (5) evaluate and demonstrate the value of IT 
training (collect information on how job performance is. affected by training, 
assess evaluation results in terms of business impact) . (An appendix 
constituting more than 90% of this document contains a detailed report on the 
GAO study's objectives, scope, methodology, and findings.) (MN) 
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Practices of Leading Private-Sector 
Companies 



Why GAO Did This Study 



What GAO Found 



The rapid pace of technological 
change, with its potential to 
transform the way the government 
delivers services, makes 
information technology (IT) human 
capital a critical issue for federal 
agencies. 



GAO identified 22 existing and emerging training practices used by leading 
companies to implement effective IT training. We organized these practices 
and accompanying case studies under five training management processes 
that we defined based on input from industry experts, published research, 
and previous GAO work (see table below). Although none of the companies 
was performing all the practices, the majority performed 10 or more. 



GAO has identified strategic human 
capital management as a high risk 
area for the federal government, 
and the demand for skilled IT 
workers is expected to increase 
over the long term. Given that 
competition for workers affects the 
federal government as it does any 
other employer, effective training 
of staff is essential to developing 
and retaining a qualified workforce. 

Some private-sector companies are 
recognized for their effective and 
innovative training programs for 
the rr workforce, which could 
provide models and examples for 
federal agencies. To help federal 
agencies better design and 
implement such training programs, 
GAO was asked to examine private- 
sector practices for training both IT 
and non-IT professionals (e.g., 
business managers and other staff 
needing training in IT) that could 
be used as a basis for addressing 
federal efforts. 



Organizations and experts agree that these practices could result in more 
effective training management, but in applying the identified practices, we 
noted several critical issues (e.g., funding constraints and demonstrating 
return on investment) that should be considered. The practices may also 
suggest approaches to IT training for government agencies to consider. 

GAO's discussions with leading private sector companies indicate that 
training is not simply a support function, but a strategic element in achieving 
corporate objectives. Further, although companies are adopting new ideas 
about training, many initiatives are in their early stages, and private sector 
officials expressed interest in learning about innovative practices emerging 
from the public sector. 



IT Traininq Management Processes and Sample Practices (see app. 1 for full list) 


Management processes 


Sample practices 


Align IT training with 


Enlist executive-level champions 


business goals 


Involve critical stakeholders 


Identify and assess IT 


Document competencies/skills required for each job description 


training needs 


Perform a gap analysis to determine needed training 


Allocate IT training 


Use an Investment process to select and manage training projects 


resources 


Provide resources for management training, e.g., leadership and 
project management 


Design and deliver IT 


Give trainees choices among different training delivery methods 


training 


Build courses using reusable components 


Evaiuate/demonstrate the 


Collect information on how job performance is affected by training 


value of IT training 


Assess evaluation results in terms of business impact 



Source: GAO. 

Note: Analysis of company-provided information. 



www.gao.gov/cgi-bin/getrpt7GAO-03-390. 

To view the full report, Including the scope 
and methodology, click on the link above, 
more information, contact Joel 
mssen at (202) 512-6253 or 
nssenj@gao.gov. 
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January 31, 2003 

The Honorable Tom Davis 
Chairman 

Committee on Government Reform 
House of Representatives 

The Honorable Jim Turner 
House of Representatives 

The rapid pace of technological change, with its potential to transform the 
way the government delivers services, makes information technology (IT) 
human capital a critical issue for federal agencies. We have identified 
strategic human capital management as a high risk area. In the long term, 
demand for highly skilled IT workers is expected to increase. According to 
a 2002 study of private-sector employers by the Information Technology 
Association of America (ITAA), the demand for these highly skilled IT 
workers exceeds supply.^ Given that this reported shortage affects the 
federal government as it does any other employer, effective training of staff 
is essential to developing and retaining a qualified workforce. 

Our objective was to examine private-sector workforce training practices 
for both IT and non-IT professionals (e.g., business managers and other 
staff needing training in IT). To achieve this objective, we reviewed existing 
research, held discussions with academic and professional authorities, and 
interviewed executives and managers at leading companies about their IT 
training management practices and activities. We also collaborated with 
the National Academy of Science to host a panel discussion with academic 
authorities. The experts on this panel discussed overall training issues, 
provided input on training management processes, and identified other 
effective training practices. We used this information, as well as the 
extensive research and trade literature available on IT training practices, to 
develop a view of what leading private-sector organizations are doing in the 
IT training area. 

On October 18, 2002, we provided briefing slides on the results of our study 
to you in your capacities as Chairman and Ranking Minority Member of the 
Subcommittee on Technology and Procurement Policy. These results, along 



'Information Technology Association of America, Bouncing Back: Jobs, Skills, and the 
Continuing Demand for IT Workers (May 2002). 
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with additional information and new and expanjded case studies, are 
included as an appendix to this letter. The purpose of this letter is to 
officially transmit the information in published form to you as Chairman 
and Member of the Committee on Government Reform. 

In brief, we found 22 existing and emerging practices that are used by 
leading companies to implement effective IT training. The meyority of the 
companies performed 10 or more of the identified practices, but none was 
performing all. The practices and case studies provided in the appendix 
suggest approaches to IT training that government agencies could consider. 

In addition, we noted several critical issues (e.g., funding constraints and 
demonstrating return on investment) that should be considered in 
implementing these practices. GAO’s review of private-sector practices 
indicates that training is not simply a support function, but a strategic 
element in achieving corporate objectives. Further, although companies are 
adopting new ideas about training, many initiatives are in their early stages, 
and private-sector officials expressed interest in learning about innovative 
practices emerging from the public sector. 

Many organizations contributed to our study. American Telephone & 
Telegraph (AT&T), Cable & Wireless, Cisco, Delta Technology, Fannie Mae, 
FleetBoston, International Business Machines (IBM), International Truck 
and Engine, Raytheon, Science Applications International Corporation 
(SAIC), and United Services Automobile Association (USAA) all met with 
us to discuss their training programs. The federal Chief Information 
Officers (CIO) Council, the Information Technology Association of America 
(ITAA), the Private Sector Council, and the American Society for Training & 
Development (ASTD), as weU as IT consulting firms Gartner and Giga, also 
provided assistance and information. 

Unless you publicly announce the contents of this report earlier, we plan no 
further distribution until 30 days from the report date. At that time, we will 
send copies of this report to interested congressional conunittees. In 
addition, copies will be made available to others upon request. Copies of 
this report are also available at no charge on GAO’s Web site at 
www.gao.gov. 
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If you or your offices should have any questions concerning this report, 
please contact me at (202) 512-6253 or Megen Davis, Assistant Director, at 
(202) 512-6398. We can also be reached by EJ-mail at willemssery@gao.gov 
and davism@gao.gov, respectively. Key contributors to this report were 
Barbara Collier, Vijay D’Souza, John Ortiz, Tom^is Ramirez, Jr., and Gleim 
Spiegel. 




Joel Willemssen 

Managing Director, Information Technology 
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Contents 


Introduction and Objective 
Scope and Methodology 
Background 

Private-Sector Practices 




• Aligning IT training with business goals 

• Identifying and assessing IT training needs 

• Allocating IT training resources 

• Designing and delivering IT training 

• Evaluating/demonstrating the value of IT training 




Critical Issues 




Final Note 
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Introduction and Objective 



GAO has identified strategic human capital management as a high risk area for the 
federal government. According to a study of private-sector employers by the 
Information Technology Association of America (ITAA), the demand for skilled IT 
workers exceeds supply, and the shortage is expected to continue. ^ Given that the 
shortage affects the federal government as it does any other employer, effective 
training of existing staff is essential to developing and retaining a qualified 
workforce. 

Some private-sector companies are recognized for their effective and innovative 
training programs, which could provide models and examples for federal agencies. 
To help federal agencies better design and implement IT workforce training 
programs, you asked us to examine private-sector training practices both for IT 
professionals and for other staff needing IT training (e.g., business managers) that 
could be used as a basis for addressing federal efforts. 



' Information Technology Association of America, Bouncing Back: Jobs, Skills and the Continuing Demand 
for IT Workers (May 2002). 
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Scope and Methodology 
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We selected companies considered leaders in IT training by professional 
organizations, publications, and academic experts. We based our selection on 
awards, significant accolades, and expert recommendations. Specifically: 

• We searched published sources and the Internet for companies recognized as 
leaders by trade associations and industry publications. Examples include 
Computerworld and Training magazine rankings. 

• We solicited recommendations from industry and academic experts. 

• To identify and establish contacts with candidate companies, we consulted 
with 

• the federal Chief Information Officers (CIO) Council; 

• professional associations (the Information Technology Association of 
America, the Private Sector Council, and the American Society for Training 
& Development); and 

• IT consulting firms (Gartner and Giga). 
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Scope and Methodology 


On the basis of our discussions and analyses, we conducted site visits at 1 1 


companies identified as leaders in IT training: 


• American Telephone & Telegraph 


• International Business Machines 


(AT&T) — Telecom 


(IBM) — Technology 


• Cable & Wireless — Telecom 


• International Truck and Engine — 


• Cisco — Technology 


Manufacturing 


• Delta Technology — Airline 


• Raytheon — Defense & Electronics 


• Fannie Mae — Finance 


• Science Applications International 
Corporation (SAIC) — Research & 


• FleetBoston — Finance 


Engineering 

• United Services Automobile 
Association (USAA) — Finance & 
Insurance 
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Scope and Methodology 



At the companies visited, we reviewed training program documentation and 
interviewed executives, business unit managers, training managers, and training 
recipients about their programs. 

Specifically, we provided a standard set of questions to each company to obtain 
information on the organizational placement, structure, and management of 
training. We also obtained additional documentation on specific training initiatives. 

We analyzed the data to identify existing and emerging training practices. The 
majority of the companies performed 10 or more of the identified practices, 
although none was performing all. However, organizations and experts agreed that 
all the practices could result in more effective training management. The 
companies also reviewed and commented on a draft list of the practices. These 
practices may suggest improvements in public sector training programs. 

We also analyzed the data to develop specific case studies that exemplified one or 
more of the practices. At the conclusion of our research, all companies reviewed 
and verified the accuracy of our descriptions of their training initiatives. We did not, 
however, verify the accuracy of claims made by the companies. 
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Scope and Methodology 



To organize our work, we grouped the practices and case studies into five 
categories (training management processes) that we identified based on input from 
industry experts, published research, and our previous work. The categories are (1) 
aligning IT training with business goals, (2) identifying and assessing IT training 
needs, (3) allocating IT training resources, (4) designing and delivering IT training, 
and (5) evaluating/demonstrating the value of IT training. 

To validate our methodology, we consulted internal and external experts on 
workforce development and training issues. 

Also, as part of the consultative process, we collaborated with the National 
Academies of Science to host a 1-day panel discussion with academic authorities. 
The panel experts discussed overall training issues, validated our management 
processes, and identified effective training practices. The panel’s insights provided 
a broader perspective than companies alone could provide. 
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Further, we facilitated on-line discussions of preliminary results with academic, 
private-sector, and cognizant GAO staff to solicit comments and feedback on key 
issues. 

We conducted our review from November 2001 to November 2002, in accordance 
with generally accepted government auditing standards. 
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Background 



• Training is a vital part of the human capital equation. An organization’s 
approaches to human capital development and training should be aligned to 
support its mission, vision, goals and objectives, and strategies. 

• According to a study by the National Association of Public Administration,^ 
there is a lack of investment in continuous learning within the federal 
government. The study further stated that this lack of investment is especially 
problematic in the dynamic and rapidly changing world of IT. 

• As companies are forced to develop and implement effective IT training 
programs with fewer resources, they are exploring innovative approaches to 
training using both existing and emerging practices. 

• The following practices, grouped into management processes, may help 
federal agencies improve their IT training programs. 



2 National Academy of Public Administration, The Transforming Power of Information Technology 
(August 2001). 
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Align IT training with 


• Enlist executive-level champions (sponsorship) to ensure that training strategies are incorporated Into 


business goals 


corporate decisionmaking and aligned with business goals 

• Involve critical stakeholders, such as top management, business unit managers, subject matter 
experts, human capital staff, and end users, in planning IT training 

• Address future skill needs and new technologies as part of the planning process 


identify and assess IT 
training needs 


• Identify and document competencies/skills required for each job description 

• Maintain a current inventory of skills 

• Address overall career development issues as well as skill-specific training issues 

• Perform a gap analysis to determine where training is needed 

• Use self-directed tools, such as individual development plans, to give employees responsibility in 
assessing their development needs 

• Use a single portal to give staff and managers access to training and career development information 


Allocate IT training 
resources 


• Ensure that an investment process is in place to select and manage training projects 

• Consider the benefits and costs associated with various training design and delivery methods — e.g., 
Internet-based as opposed to classroom training 

• Identify people who have high potential and provide them specialized training opportunities 

• Ensure that resources are allocated for management training — e.g., leadership and project 
management 


Design and deliver IT 
training 


• Provide IT trainees with the flexibility to choose among different IT training delivery methods 

• Ensure that on-the-job training is planned and monitored as part of the training process 

• Consider combining different teaching methods (for example, Web-based and instructor-led) within the 
same course 

• Provide just-in-time training 

• Consider outsourcing training solutions — e.g., university partnerships and external IT training and 
content providers 

• Build courses using reusable components 


Evaluate/demonstrate 
the value of IT 
training 


• Collect information on how job performance is affected by training 

• Validate IT content learning by testing and certification of specific skills — e.g., Java or C++ 

• Assess evaluation results in terms of business impact 




10 



Page 13 



17 



6AO-03-390 Information Technology Training 



Appendix I 

Information Technology IVaining 



A GAO 

Accountabinty * integrity * ReMablHty 

Aligning IT Training with Business Goals 

By linking IT training programs to their overall business strategy/goals, companies 
can promote staff development that can best achieve corporate objectives. 

While the majority of the companies we visited are performing one or more of the 
key practices associated with aligning IT training to the overall goals of the 
company, only two have developed comprehensive planning processes to achieve 
this alignment. 
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Aligning IT Training with Goals 



Practices 

• Enlist executive-level champions (sponsorship) to ensure that training 
strategies are incorporated into corporate decisionmaking and aligned with 
business goals 

• Involve critical stakeholders, such as top management, business unit 
managers, subject matter experts, human capital staff, and end users, in 
planning IT training 

• Address future skill needs and new technologies as part of the planning 
process 
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Aligning IT Training with Goals 

Case Study 1 



A process was established to link iearning strategy to overaii business 
direction. 

Practice iiiustrated 

• Involve critical stakeholders 



Background 

Between 2001 and 2002, this large telecom company reorganized its training 
program. The company believed it could no longer meet “new world challenges 
using the old world model.” It did not have a process linking a well-planned and 
defined training program to corporate business strategies. 

Chaiienge 

To create a process that links training to an overall business strategy to achieve 
business objectives. 
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